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ABSTRACT 



A multi-stage architecture for providing a single switching 
component in multiplicity to create a single network capa ble 
ofjjerfcfniu^ a^au!u^Ucitv_of functions. One function of 
the disclosed network is to circumvent the traditional b lock- 
ing problems in TTMilti -staqe networks by implemen ting 
attrrmatf, pathsi t ^tween devices within the same 
netwjffkJ D^jpermits a non-blocked path between 2 dev ices 
tafeef pund by rearrangeability--me act of trying or sea rch- 
i ng different alternate paths until a non-blocked conn ection 
i s established. A second network function permits a spe cial 
h igh priority mode of transfer w hi ch will guarantee thai the 
connection ypi\ he made_to_an idle device as rapidly as 
possible. 

4 Claims, 4 Drawing Sheets 
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MULTI-FUNCTION NETWORK BACKGROUND OF THE INVENTIONS 

CROSS REFERENCE TO RELATED Multi-stage Switching Networks have become an 

APPLICATIONS accepted means for interconnecting multiple devices within 

The present patent application is a continuation of U.S. , ? ^Ti* ° fteD ^ tiple S ath8 

Ser. No. 08/216,789, filed Mar. 23, 1994, now abandoned, 5 ^™gh the switching netwo^ to perform different func- 

which was a continuation of U.S. Ser. No. 07/799,497, filed ? ons *.^ ^ * by Peter Ranaszek, as 

Nov. 27, 1991, now abandoned, which also claims priority descn * d * work entitled "Path merardues in Inter- 

and is a continuation-in-part of the following related com ! ectl ? n Netwc*ks» described two hierarchical paths far 

co-pending patent appUcations. a netwark » one Providing low-latency message transfer and 

-Asynchronous Low Latency Data Recovery Apparatus 10 ? C ^JT^ 8 gpf^^-df very of a message trans- 

and Method", Betts et al, S^S^JM^ f? a ^ 0 ^ 

Feb. 22, 1991; abandoned in favor of Ser. No. 08/089,056, ?j£Z£L Tl%t^ n ^tlS^t 

filed Jul. 8, 1993; and abandoned in favor of Sen No latency path first If ^hmm^^d^toUoAa^a 

csiiAm aw fiiJji Tm^oi ioq< w --/^ contention, it is retransmitted over the guaranteed-delivery 

22 is path - 11113 aUows usuany about *>* of * e messages to * 

«!« xt j c a tt i i j tt u ~ j a t. sent successfully over the low-latency path, and guarantees 
All-Node Switch, An Unclocked, Unbuffered Asynchro- ^ delivcry ^ a message that gets blocked on the low- 
nous Switching Apparatus" by P. A. Eranasek et al, U.S. Ser. latency path ^ t0 retransmissions. 

^ /6 V^f^^ 9 ; ^V^T^ fa ^ ? f U " S - Pat * No * 4 > 952 > 930 to R A- 61 * 

Ser. No 08/143,977 fi^ Aug. 28, 1990 described the approach which used a second 

favor of Ser. No 08/457, 789 filed Jun. 2, 1995; 20 ^ ^ fa ^ ^ tQ ^ 

Broadcast/Switching Apparatus For Executing approach. However, it suffered by its requirements of a 

Broadcast/Multi-Cast" by H. T. Olnowich et al, U.S. Ser. plurality of switches t0 implement it ^ there would ^ 

No. 07/7483 16, filed Aug. 21, 1991; now issued as U.S. Pat no impediment to our adopting the teachings of this patent 

No. 5,404,461; remained a Dee <i f or a simpler and yet more flexible 

^ulti-Sender/Switching Apparatus For Status Reporting approach to create a multi-stage network. 

Over Unbuffered Asynchronous Multi-Stage Networks" by Multi-stage networks have become an accepted means for 

IL T. Olnowich et al, U.S. Ser. No. 07/748302, filed Aug. interconnecting multiple devices within a computer system. 

21 ' They are a replacementfo-thf. traditional crossbar4ntercon- 

"Sync-Net— A Barrier Synchronization Apparatus Far 3Q n ection. The crossbar is still a most efficient metho d of 

Multi-Stage Networks" by P. L. Quids et al, U.S. Ser. No. n etwork interconnecti on, but it tends to be impractical for 

07/748303, filed Aug. 21, 1991; now issued as U.S. Pat No. large systems. An NxM crossbar permits total simultaneous 

5365228; interconnecti on, where all the N devices can b e communi- 

"GVT-Net— A Global Virtual Time Calculation Appara- eating simultaneously with different members o f the setof M 

tus For Multi-Stage Networks" by P. L. Childs et al, U.S. 35 devices. T he crossbar is "non-bloc king" because there noth- 

Ser. No. 07/748,295, filed Aug. 21, 1991; now issued as U.S. ing internal to the crossbar which prevents any given N 

Pat No. 5,250,943; device from connecting to an M device which is IDLE (is 

In addition, me following applications which were filed not connected to some other N device). If an N device 

concurrently with the predecessor to this application, U.S. desires to connect to an M device which is B USY 

Ser. No. 07/799,497: 4q (previously connected to some other N device), no connec- 

'*ftiority Broadcast and Multi-Cast For Unbuffered Multi- tion can be made until the previous connection is broken — 

Stage Networks" by H. T. Olnowich et al, U.S. Ser. No. however, this is referred to as "contention" and is not called 

07/799,262, filed Nov. 27, 1991; abandoned in favor of U.S. "blocking". 

Ser. No. 08/318,578, filed Oct 5, 1994; When N and M become large (usually greater than 32 or 

•Dual Priority Switching Apparatus for Simplex Net- 45 64) it becomes very unwieldy to build crossbars since then- 
works" by P. Kogge et al, U.S. Ser. No. 07/800,652, filed complexity increases at an NxM rate and their pin count 
Nov. 27, 1991; and now issued as U.S. Pat. No. 5,444,705; increases at an (NxM)xW rate, where W=the number of pins 

•Multi-Media Serial line Switching Adapter For Parallel P° rt - Thus large networks are usually built from mulri- 

Networks and Heterogeneous and Homologous Computer sta S e networks constructed by cascading several stages of 

System", by H.T. Olnowich etal,U.S. Ser. No. 07/799,602, so smaller crossbars together to provide an expanded network 

filed Nov. 27, 1991; abandoned in favor of U.S. Ser. No. ^ disadvantage of multi-stage networks is that they are 

08/390,893, filed Feb. 15, 1995, allowed Jan. 4, 1996; and "blocking", Le., a connection might not be able to be made 

divided into (1) U.S. Ser. No. 08/178,957, filed Jan. 7, 1994, t0 811 M device because there is no path available in 

abandoned in favor of U.S. Ser. No. 08/521,774 filed Aug. the network to provide the necessary connection to the IDLE 

31, 1995, and (2) 08/178,974, filed Jan. 7, 1994. 55 device. 

These co-pending applications, issued patents, and the Among other patents which might be reviewed are: U.S. 

present application are owned by one and the same assignee, Pat No * 4,914,571 to A. E. Baratz et aL issued Apr. 3, 1990 

namely, International Business Machines Corporation of which describes a method of addressing and thus how to find 

Armonk, N.Y. resources attached to a network, but does not deal with the 

The descriptions set forth in these copending applications 60 hardware for the actual network itself, 

are hereby incorporated into the present application by this U.S. Pat No. 4,455,605 to R. L. Cormier et aL issued Jun. 

reference. 19 > 1984 which is for a bus oriented system, it is not a 

multi-stage network. Similarly, U.S. Pat No. 4396,984 to E. 

FIELD OF THE INVENTION R Videki, E issued Aug. 2, 1983 is for an I/O bus channel, 

The inventions relate to multi-function networks, and 65 not a multi-stage network. U.S. Pat No. 4,570,261 to J. W. 

particularly to a multi-function network which can operate Maher issued Feb. 11, 1986 is for fault recovery over a bus 

as a multi-stage asynchronous network. oriented system, not a multi-stage network. 
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U.S. Pat No. 4,207,609 to F. A. Luiz et al. issued Jun. 10, NETWORK composed of four 8x8 crossbar switch chips; 

1980 illustrates an I/O bus channel so that those in the art and FIG. 3b shows alternate paths which can be established 

will understand the differences between the subject matter. by connecting the previously unused parts. 

It is not a multi-stage network. FIG. 4 has two parts, wherein HG. 4a shows a 64 node 

U.S. Pat No. 4,873,517 to A. E Baratz et al. issued Oct 5 network built from 2 stages which has only 1 unique path 

10, 1989 is for a totally different type of network, not an between nodes and doesn't have any additional paths; and, 

equi-distant multi-stage network like that which we will FIG. 4b shows that by adding a stage and going to a 3-stage 

describe, and also, U.S. Pat No. 4,932,021 to T. S. Moody network as applied to a 32 node system, 8 alternate paths 

issued Jun. 5, 1990 for bus wiring paths inside a computer would exist between any two nodes, 

box, it is not a multi-stage network. U.S. Pat. No. 4,733391 "> fig. 5 shows the simple hardware implementation of 

to R. J. Godbold et aL issued Mar. 22, 1988 illustrates a ring rearrangeabiUty, hot spot detection, and changing over to 

interconnection network, which is unlike a multi-stage net- Guaranteed Delivery mode, 
work U.S. Pat No. 4,811,201 to B. R. Rau et aL issued Mar. 

7, 1989 are not applicable to a multi-stage network. U.S. Pat DETAILED DESCRIPTION OF THE 

No. 4,754395 to B. P Weisshaar et al. issued Jun. 28, 1988 is INVENTIONS 

is for aring interconnection network. fiefQre t0 ^ dmia9f it should te noted 

We have solved some of the problems encountered in the ALL-NODE switch described in the related applications is 

prior art and will describe a way whereby some of the applicable to the present inventions. The switch first 

traditional blocking problems in multi-stage networks are described in U.S. Set No. 07/677,543, abandoned in favor 

circumvented. of Ser No 08/143,977, filed Oct 27, 1993, abandoned in 

SUMMARY OF THE INVENTIONS favor of Ser * Na 08/457,789, filed Jun. 2, 1995, may be an 

8x8 switch as well as a 4x4 switch as there described, as will 

The traditional blocking problems in multi-stage net- appreciated by those skilled in the art In such a switch the 

works is circumvented by implementing ALTERNATE four data lines would be replicated and increased to eight 

PATHS between all N and M devices within the same data lines while the other features of the inventions are 

network. This permits a non-blocked path between 2 devices present 

to be found by Wangeability"-The act of trying or ^ ^ OTed thus is an Asynchronous, Low 

searching different alternate paths until a non-blocked con- mter Node crossbar switch which is self routing in 

necuon is established. It also permits some of the ALTER- Wo ^ thQSS at ^ same u ^ specd serial rate mat ^ 

NATE PATHS to be used for GUARANTEED 30 is transferred through the switch. ThTnormal mode of the 

DELIVERY — a special high priority mode of transfer which switch should req uire no synchronization means among any 

will guarantee that the connection will be made toan IDLE of its ^ t ^ output ^ wnich interface to the switch, 

device as rapidly as possible. In addition, the ALTERNATE ^ switch ^ completely void of centrally controlled clock- 

PATHS provide a much more fault tolerant network than ^ ^ ^ ^ buffering. Data which traverses the switch 

provided by state-of-the-art solutions. should only encounter three gate delays, an on chip receiver, 

As a result of our inventions we provide a single, a multiplexer, and an off chip driver. Contention will be 

unidirectional, unbuffered, multi-stage network capable of detected and resolved on the chip, and the logic 

doing the total network job consisting of multiple functions. implementation, as described in the related applications is 

The functional complexity provided usually requires four or ^ simple and low in gate count Such a switch will comprise 

more state-of -the-art multi-stage networks to perform the for a node of a network a plurality of input and output ports, 

equivalent job. Hie single network disclosed here allows and a connection control circuit for each input part, and a 

tra ffic i n both directions, provides for non-blocking via multiplexer control circuit for each output port for connect- 

ALTERNATE PATHS and REARRANGEABUJTY, incor- ing any of I inputs to any of Z outputs, where I and Z can 

porates GUARANTEED DELIVERY and FAULT 45 assume any unique value greater man or equal to two. 

TOLERANCE, and yet is very compact and inexpensive to 

implement In addition, the network is modular in nature and DETAILED DESCRIPTION OF THE 

permits easy adaptation to any sized system. PREFERRED EMBODIMENTS 

We will describe in the following detailed inventions With this background, we turn now to the drawings which 

further features and improvements. A reader may wish to 50 illustrate the inventions described here in greater detail. It 

obtain further background by reading the features and may be seen that the basic element for the construction of the 

improvements of the related applications referenced above multi-stage network is chosen here to be an 8x8 crossbar 

which are hereby included by reference. References in the switch 10 as shown in HG. 1. This 8x8 crossbar switch need 

following detailed description refer to the drawings which not be identical to the ALL-NODE unidirectional switch in 

are provided herewith. 55 order to implement the claimed invention, but that would be 

BRIEF DESCRIPTION OF THE DRAWINGS our P** 3 ^ mod& of Implementation, as described further. 

The switch is unidirectional in that it accepts inputs from 

FIG. 1 illustrates a basic element of the network, which as e ig nt different sources and can connect them to any of eight 

a preferred embodiment is chosen to be an 8x8 crossbar different destinations. It is capable of supporting eight 

switch as illustrated, go interconnections simultaneously. The output ports from one 

FIG. 2, is composed of two parts, wherein FIG. 2a, shows crossbar switch can be connected to input ports of other 
the interconnection of N processors to N memories via a crossbar Switches in a cascading fashion to provide multi- 
multi-stage network; and FIG. 2b shows a nodal embodi- stage networks which are larger than 8x8. The data lines 11 
ment for both a processor and memory; Le., both processor are by the switch 10 connected, allowing any input to pass 
and memory reside on the same side of the network. 65 data on line U to any output With eight data lines, up to 

FIG. 3 has two parts, wherein FIG. 3a shows the inter- eight simultaneous connections can be made. Broadcast is 

connection of 16 nodes using one MULTI-FUNCTION permissible, and the broadcast of the related applications is 
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the preferred mode. Guaranteed delivery is provided by the 
HI-PRI, VALID and REJECT controls, in accordance with 
the application filed concurrently herewith, U.S. Ser. No. 
07/800,652, U.S. Pat. No. 5,444, being the best mode. 

The network itself is unidirectional and it is built from 5 
unidirectional 8x8 CROSSBAR SWITCHES. It is possible 
to accomplish two-way_tauisfers_u siiig jwu^ajimdirectional 
network. Toexplain tMs^onsider FIG. la, which shows the 
interconnection of N processors represented by the PROC 

22 block to N memories represented by the MEMORY block l0 

23 via a multi-stage network. Normally the processors are 
loc ated on one side o Lme-network, Jhe_m emorie sjM jhe 
other side, and a unidirectional network 24 in each dire ction 
is required for the two jo communicate . However, modern 
parallel processors iinplementajnodal con ce pt,.where a n ode 15 
contai ns both a processor and memo ry; jlT, both processor 
and memory reside on the same sicfe of the network as 
shown in HGT26?Thus, one unidirectional network 24 is 
sufficient to allow complete communication between all ^ 
nodes. As shown in FIG. 2Z>, each node, NODE 1 and NODE 2Q 
2 being representative of N nodes, has two interfaces to the ^ 
unidirectional network, one interface 26 to source data tq the 
network and one interface 27 to re ceive data from the 
network 24ri n turn, the source jlata leavin^ lnirnode can 
come fr om two sourc es: 1) REQUEST — a processor can be 25 
requesting a memory access from another node, or 2) 
RESPONSE— the memory can be responding to an jiccess 
request from another node. The node, therefore, has to 
timej^ltiplex^mesejwp^ 

s ource interface lines to the network in^a. standard mu lti- 30 
plexing maimer, fami liar to those skilled in the art Likewise, 
data~destine<i"^for an y node andjffiriving_over the single 
re^rve.oonnect^ 1) 
MEMORY — another node can be requesting a memory 
access from this node, or 2) PROCESSOR— another node 35 
can be returning a memory access requested by the proces- 
sor. 

In summary of the^aboye conclusions, it is entirely 
feasible to support r wo^wa)^ communication between all 
nodes using only a single unidirectional network. There are 40 
two types of data traversing the network: the sending of 
REQUESTS and RESPONSES to other nodes and the 
receiving of REQUESTS or RESPONSES from other nodes. 
It is this type of network that is most efficient and flexible; 
therefore, it is the basic network which is expanded by this 45 
disclosure to incorporate multiple functions. 

FIG. 3a shows the interconnection of 16 nodes (with 
NODE 1-NODE 16 representing the connection) using one 
MULTI-FUNCnON NETWORK composed of four 8x8 
crossbar switch 10 functional blocks. It shows that the 16 50 
nodes can be completely interconnected by only partially 
using the available crossbar switch output ports; i.e., the 
right side of each of the two 8x8 switches 10 A and 10B that 
receive the unidirectional inputs from.the 16 nodes makes 
only two va^^oimegtior^^ttje left siie.Qf.each.of^e_two 55 
8 xs sw itches IOC and 10D that send unidirectionaToutputs 
to the 16 nodes. This leaves 6 unused output ports on each 
of thej wo 8x8 sw ftche^^tiiatjrecejye the unidirect ional 
in puts from .th e 16 nod es, and 6jnusedJ nput ports on each 
of the two 8x8 switches 10 that send unidirectional outputs 60 
to the 16 nodes, as shown in FIG. 3a. TJiejssidJnteicpn- 
necttonsc heme provides one and only one unique pa th 
be tween any twojiodes ( no Alternate Paths exist). However, 
Alternate P aths can be establishe4^ s_^twiLinJKL^fr_by 
connecting the sixprgyiously unused ports 6 in the ma nner 65 
derngnstrg gTNow there are four Alternate Paths40, 41 , 42, 
and43 whereb y any node can be connected to any ot her 



node. For instance^n ode 1 can be connected to send unidi- 
rectional REQUESTS or RESPONSES to node 7 equally 
well ovexany ; of Adifferejrt ji etwork connections — path 40, 
41, 42, or 43. 

The Alternate Path concept can be applied to any number 
of nodes. For instance, FIG. 4a_ shows how a 64 node 
network built from two stages which has only 1 unique path 
60 to 68 between nodes and doesn't have any additional 
paths can be modified to introduce alternate paths into the 
network. FIG. 4fr shows that by adding a stage and going to 
a 3- stage network, that the network can be expanded to 
implement 8 alternate paths. 

The disclosed network applies to multistage networks 
which implement Alternate Paths and which use. these 
Altern ate Path s to circumvent network blockage through 
reanangeability. The device sending data into the network 
selects an Alternate Path either randy y ly h r by the preferred 
embodiment based on the l ow order address bits of the no de 
being.accesse d via the ne twork. Th e sending node tries t o 
establish a connection to the receiving node over the Al ter- 
nate Path_selected TIf that path is blocked, it receives back a 
indication, fit then "rearranges its path selection 



decision and selects a different Alternate Path . The subse- 
quent selection is made either r andomly or by the preferred 
embodiment method of storing the low order address bits 01 
the node being addressed in a binary counter, incrementing 
the counter by +1 every time a REJECT indication is 
received, and then retrying the connection over the newly 
selected Alternate Path as defined by the binary counter. This 
rearranging can continue indefinitely as the counter will loop 
on itself, thus retrying the Alternate Paths in succession or 
at ran dom until blockade is successfully circumven ted 
Note, that a network incrementing four Alternate Paths, as" 4 
shown in FIG. 3b, woittdJnMalty select a path based upon 
th e two low order ad^sTbitTof the addressed node and 
then_5tor e these two bits in a two-bit co unter for rearrange- 
abiUtyJncrem^nting." t is recognized tfiat"Heidelberger and 
Franazek reported in {Traffic Studies of Unbuffered Delta 
Networks" (RC 1410 3 (#63219)rGomputer Science, Oct 
17, 1988 and IBM Technical Journal January, 1991) that 
their simulations have shown that two types of network 
traffic exist "Hot" and "Cold". "C old" being random traffic 
and "Hot" being concentrated trafficto one particular node. 
The said studies have shown that "Cold" traffic gets through 
the network with a very high rate of probability on one of the 
first several tries at rearrangeability. However, this is not true 
for "Hot" traffic which becomes less likely to be successfully 
delivered with each successive retry and tends to clog the 
network Therefore, the present disclosed rearrangeability 
method can be efficiently applied to "Cold" traffic in an 
unbuffered network, but something additional is required to 
handle "Hot" traffic. 

The solution to the "Hot" traffic problem is to confine the 
"Hot" traffic to a specific Alternate Path and thus keep i t 
frprn affecting the "Cold! ' traffic being transmitted over the 
other Alternate Paths. In addition, a method is required to 
handle the "Hot" traffic in an orderly and efficient manner so 
that it is processed as quickly as possible and in a manner 
that prevents the "starvation" of any particular node (the 
blocking of a parti cular node or nodes from ever getting a 
connection to a node that is experiencing "Hot" traffic). The 
approach which provides the required orderly servicing of 
"Hot" traffic and the prevention of starvation is called 
"Guaranteed Delivery" or "High Priority Mode" as dis- 
closed in "A Dual Priority Scheme for Simplex Networks" 
by H. T. Olnowich, et al; U.S. Ser. No. 07/800,652, filed 
Nov. 27, 1991 U.S. Pat No. 5,444,705. The said disclosure 
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defines a second level of network interconnectivity as a high Path regardless of how many nodes are requesting to 

priority mode of network operation which reserves partial send messages to that node. This frees up all the 

paths for a "Hot" transmissions up to the point of blockage. remaining Alternate Paths to be used for "Cold" traffic 

In this High Priority mode the blocked stage is then won for and confines blockage due to "Hot" traffic to one "Hot" 

the halted "Hot" traffic as soon as the blocked stage becomes 5 Alternate Path (although it is possible for several or 

available. The transmitter is informed of the removal of the many nodes experiencing "Hot** traffic at the same time 

blockage and a retry occurs at the earliest instant of time and to several ^ Alternate Paths to be operat- 

bWkS 1611 * * gUarantCed to gCt tbr ° Ugh previousl y ing in the "Hot" mode simultaneously-there is no 

blocked stage. restriction as to how many Alternate Paths can be 

Thus the, overall rearrangeability me thod im plemented by 10 operating in "Hot" or "Cold" mode simultaneously), 

the disclosed MUU1-FUNCTION NETWORK handles Multiple ^ » spo ts could require the dedication of 

both "Hot" and "Cold" traffic efficiently is as fellows: more man on c Alternate Patfa'if the low order node 

1) The first several tries assume that the traffic is "Cold" a ddress bits are different f or diffe rent hot spots, b ut the 
and establish a first connection through the network approach wo uld stmlaMe"muT55e^ot" sp ots effi- 
based on either a random selection of an Alternate Path 15 cienu^foadaition, it is possible for some "Cold" traffic 
or the low order address bits of the node which is during normal rearranging to attempt to use the "Hot" 
receiving the message, as described above. If the Alter- Alternate Path, but it will be rejected and via continued 
nate Path selected first has no blockages, the connec- rearrangeability go on to find a "Cold" Alternate Path 
tion is successful and the "Cold traffic" is sent success- where it does get through the network successfully, 
fully. However, if the first Alternate Path has blockage, 20 Another, advantage of the preferred approach is that all 
the Multi-function Network rejects the connection. A Alternate Paths are available to handle "Cojii" traffic for the 
second Alternate path is selected automatically by the normal case of random traffic only— whenno "Hot" traffic 
hardware either randomly or by incrementing the low exists. Thus for the normal case, the Alternate Paths are all 
order address bits of the receiving node address, as usable to provide increased network bandwidth, 
described above. Subsequent, retries can be made in a 2s FIG. 5 shows the simple hardware implementation of 
similar manner until one is successful, the connection rearrangeability, hot spot detection, and changing over to 
is established, and the network transfer is made. In Guaranteed Delivery mode included in each node coupled to 
general, the finding of a non-blocked path and subse- the network: FIG. 5 shows the hardware which permits the 
quent successful message transmission through the finding an unblocked path through a multi-stage network 
Multi-Function Network will occur for all "Cold" traf- 30 and the circumventing of "Hot" spots in network traffic 
fie* using a method which is performed automatically and trans- 

2) A means is required to detect "Hot" traffic and to then parently in relation to the software. The implementation 
change the mode of transmission over the MuM- shown is for the control of four Alternate Paths and the 
Function Network to a second and more efficient mode hardware only requires two 1-bit muxes (MUX-2 and MUX- 
for the handling of "Hot" traffic. A rearrangeability 35 3) and two counters (Retry Counter-4 and Alternate Path 
retry counter is maintained to count the number of Control Counter 5). The two mux's (nniltiplexers) provide 
times a message is tried over the network (the number an output of two encoded bits which define which of the four 
a times an Alternate Path selection is made). A pro- Al ienate R a&s-4s-te-be ^selected at any given tim e. The 
grammable threshold is placed on this retry counter, mux's 2 and 3 are controlled from the Retry Counter-4 
such that after the number of tries defined by the 40 which is reset to 0 at the beginning of every new message, 
threshold is surpassed, the traffic is reclassified as being Both counters 4 and 5 are incremented based on the REJECT 
"Hot" traffic. For example, assume that the retry thresh- signal indicating that the path that was tried was blocked and 
old is set for a total of 3 tries at establishing a a subsequent REJECT indication was issued When the 
connection through the said network as "Cold" traffic. Retry Counter-4 contains a count of 0, 1, or 2, the mux 
Then, after the third unsuccessful try, the message is 45 control is selected to take the Alternate Path number from 
reclassified as "Hot" traffic and a new method of the output of counter-5 which causes rearrangeability to 
delivery through the MULTI-Function Network is occur. For all other values of the Retry Counter-4, the mux 
brought into effect or the counter can be allowed to control is selected to take the Alternate Path number from 
continue by looping back on itself as mentioned pre- the low order address bits of the receiving node address as 
viously.llie rearrangeability (**Cold") method of deliv- 50 store d in Node Address Register 1. T hus for the very first try 
ery is replaced with the "Guaranteed Delivery" ("Hot") and for Guaranteed Delivery, the Alternate Path number 
method. comes from the low order bits of the Node Address Register 

3) "Guaranteed Delivery" can be.acoomplished.by-eimer 1. When the Retry Counter-4 contains a count of 3 or more, 
of two m emofe.aLselectfog-^m e_OT_ several uniqu e "Hot" traffic detection is made and the Guaranteed Delivery 
Alt ernate Paths which are to receive all "Hot" tr affic 55 mode is forced by the hardware. Control counter 5 is loaded 
and no Xold" traffic, or b) mixing "Hot" and "Cold" from the low order bits of Node Address Register 1 during 
traffic on the same Alternate Paths by sdecting Jhe the first try is increment by each rejection. 
"Hot"_ path on the basis of the low order node addres s The Alternate Path approach also provides better fault 
bits (th e same bits that defined the first path to be tried tolerance compared to single path systems because many 
under the rearrangeability method). The later is the 60 component or wiring failures will only take out 1 or several 
preferred embodiment that is described for the present of the Alternate Paths and still leave some usable paths, 
invention. For the later and preferred method, the path Far cases where better fault tolerance or network band- 
selected for "Hot" traffic is forced into the Guaranteed width is required, it is possible to implement multiple copies 
Delivery Mode of operation. The advantage of the of the simplex network described above— with each copy 
preferred approach is that since the "Hot" Alternate 65 implementing its unique set of Alternate Paths. 

Path selection is based on the node address, all traffic to Clearly, while we have disclosed our preferred embodi- 

that "Hot" node will be forced onto the same Alternate ments and best mode of practicing our inventions, they can 
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be the basis far much growth in performance of network 
systems. TTiose skilled in the art, both now and in the future, 
will envision further improvements, features and 
enhancements, even by way of further invention, without 
departing from the scope of the following claims which 
should be construed to protect and maintain the proper scope 
of our inventions in light of other prior developments. 
What is claimed is: 

1. A multi-stage bufferless switching network, the net- 
work comprising: 
a plurality of bufferless switching apparatuses cascaded 
into stages, each said switching apparatus including a 
plurality of switch inputs and a plurality of switch 
outputs, each of said switch outputs coupled to a switch 
input of another of said switching apparatuses, the 
switch outputs of last stage switching apparatuses each 
coupled to a switch input of a first stage switching 
apparatus through one of a plurality of nodes, the 
switch outputs of last stage switching apparatuses com- 
prising network output ports and the switch inputs of 20 
first stage switching apparatuses comprising network 
input ports; 
the switching apparatuses each including: 
means for establishing a plurality of direct connections, 
a direct connection connecting any one of the net- 
work input ports to any one of the network output 
ports, in response to connection requests received at 
a plurality of the network input ports, for transmit- 
ting data from said plurality of the network input 
ports to a plurality of the network output ports, the 
direct connection comprising one of a plurality of 
pathways connectable from said any one of the 
network input ports to said any one of the network 
output ports; and 
detecting means coupled to each switch output for 
detecting a blocked switch output in the pathway of 
the direct connection; and 



25 



30 



35 



each of the nodes including: 
rearrangeability means coupled to a connected network 
input port for sending a connection request to the 
connected network input port for an alternate direct 
connection between said any one of the network 
input ports and said any one of the network output 
ports in response to said detecting means detecting 
the blocked switch output 

2. The network according to claim 1, wherein each of said 
nodes further include one or more network devices, thereby 
allowing each of the network devices to transmit data to any 
other of the network devices via one network input port and 
one network output port 

3. The network according to claim 1, wherein the rear- 
rangeability means includes: 

address register that stores at least part of an address of a 
targeted node; 

multiplexor means, operably coupled to the address 
register, for providing an alternate path selection based 
on the at least part of the address of the targeted node 
or based on an updated address; 

a first counter that provides a control signal for determin- 
ing whether the multiplexor means will provide the 
alternate path selection based on the at least part of the 
address of the targeted node or based on an updated 
address; and 

a second counter operably coupled to the multiplexor 
means, wherein the second counter provides the 
updated address. 

4. The network according to claim 1 wherein said means 
for establishing a plurality of direct connections establishes 
said direct connections simultaneously and asynchronously 
in relation to a plurality of connection requests received 
separately at a plurality of the network input ports. 
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